REMOTE CONTROL SYSTEM AND HOME GATEWAY APPARATUS 



Background of th e Invent inn 
(Technical field) 
5 The present invention relates to a remote control system 

for controlling home appliances from outside the home and a 
gateway apparatus used for the remote control system, and in 
particular, to the system and apparatus capable of controlling 
the home appliances from outside the home with easier 
10 operations. 

(Related art) 

In recent years, in order to build a system in which home 
appliances are connected to a network built inside the home 
(home network) so as to be controlled those appliances, 
15 standardization for protocols of the home network that use IEEE 
1394, BLUETOOTH, and/or power lines is now in progress. The 
home appliances have already been partly mutual-connected for 
linked usage, and home appliances can be connected to personal 
computers or to other home appliances (such that a floor type 
20 of VTR is connected to a video camera) . 

A Japanese Patent publication No. 3016350 discloses a 
system for a home appliance control interface, in which there 
is provided a personal computer for operating home appliances 
and an image indicative of rooms in which the home appliances 
25 are placed. 

Another Japanese Patent publication No. 3014532 
discloses a home automation system. In this system, the layout 
view of rooms of a house is displayed on a personal computer 
used for controlling home appliances, such as a bath and air 
30 conditioner. For example, when a user performs operations on 
the layout view of the air conditioner, contents of operations 
for a wind direction, wind amount, setting of temperature. 
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necessity for dehumiditif ication and/or others are displayed 
on the view. Based on a selected content to be operated, the 
system is able to actuate the air conditioner. In this home 
automation system, the personal computer is connected to a 
5 second personal computer through a telephone line, so that a 
user is able to give data to the second personal computer to 
control the home appliances from a distance. 

With regard to a control interface for home appliances , 
remote control devices have long been used. Japanese Patent 

10 publication 6-32509 discloses a remote control apparatus, in 
which replacement of ROMs allows a plurality of appliances to 
be controlled. This remote control apparatus has a display unit 
for displaying figures illustrating operation panels of the 
appliances to be controlled. Pressing a key on an operation 

15 panel that has been displayed enables control of a desired 
appliance . 

Further, the Internet has widely become popular in recent 
years, and use of a home computer and portable terminals or 
mobile terminals makes it possible to have access to the 

20 Internet from any place. To control a personal computer with 
functions for home appliances (e.g. , a personal computer with 
the functions for a TV tuner and picture recording) via the 
Internet has already been conducted. Practically, a portable 
terminal is used outside to send to a mail box on the Internet 

25 an electronic mail in which pieces of information indicating 
instructions to control a home appliance are written. On the 
other hand, a home personal computer is actuated to regularly 
access the electronic mail box. If the home personal computer 
finds an electronic mail containing the information in relation 

30 to instructions of control, the function of the personal 
computer is activated. 

In this configuration, the portable terminal extracts a 
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function, operation data for reserving picture recording, and 
a start time and an end time of recording of a broadcast channel. 
And the portable terminal uses these pieces of information to 
produce the information about the control instructions that can 
be interpreted by a program installed in the personal computer. 
The produced information is then sent out with the electronic 
mail . 

For a further example of accessing a computer system via 
a communication network, a system has been known in which 
terminals control a host computer based on programs on API 
(application programming interface) specifications that 
include communication protocol processing. 

However, the conventional systems have given no 
consideration to a direct connection of a home network to the 
Internet, because there are differences in protocols between 
the home network connected to home appliances and an outside 
computer network (e.g. , Internet) connected to the home network. 
In addition, the home appliances are not equipped with the API 
capable of receiving control commands sent from outside the home 
via the Internet and operating the home appliances . Therefore, 
there is a problem that the conventional systems are unable to 
remote-control home appliances from outside the home via the 
Internet, though the Internet itself has now considerably 
become popular. 

Moreover, in the case of conventional remote-control 
techniques, there is a possibility that conflicts occur between 
direct operations and remote operations toward a certain home 
appliance . 

Still further, there is a fear that an immoral user might 
perform a remote control to give home appliances a breakdown 
or information about the leakage of privacy. 
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Summary of the Tnvftntinn 
The present invention has been made with consideration 
of the above problems faced by the conventional techniques, and 
an object of the present invention is to provide, with higher 
reliability and easier operations, a remote control system 
capable of controlling home appliances through a network 
connected to the home. Also a further object of the present 
invention is to provide a gateway apparatus for realizing the 
above remote control system. 

To realize the objects, in the present invention, there 
is provided a gateway apparatus connected to at least one 
appliance through a first network, the apparatus comprising: 
appliance panel information inputting means for acquiring 
appliance panel information indicating panel parts of the 
appliance and an operational range of the panel parts; gateway 
apparatus information memorizing means for memorizing gateway 
apparatus information indicative of whether or not a control 
command input from a second network to the appliance is allowed 
to be accepted; and appliance control command producing means 
for determining, with reference to the gateway apparatus 
information, whether or not the control command input is 
possible be accepted in cases where the control command input 
has been received through the second network or without through 
the network, and for producing a control command toward the 
appliance on the basis of the appliance panel information in 
cases where it is determined that the control command input is 
possible to be accepted. 

Further, in the present invention, there is provided a 
gateway apparatus connected to at least one appliance through 
a first network, the apparatus comprising: appliance panel 
information inputting means for acquiring appliance panel 
information indicating panel parts of the appliance and an 
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operational range of the panel parts; gateway apparatus 
information memorizing means for memorizing gateway apparatus 
information indicative of whether or not a control command input 
from the first network or a second network to the appliance is 
5 allowed to be accepted; and appliance control command producing 
means for determining, with reference to the gateway apparatus 
information, whether or not the control command input is 
possible be accepted in cases where the control command input 
has been received through the first network or the second 

10 network or without through the networks, and for producing a 
control command toward the appliance on the basis of the 
appliance panel information in cases where it is determined that 
the control command input is possible to be accepted. 

Still further, in the present invention, there is 

15 provided a gateway apparatus connected via both a service server 
producing credit information and a network so as to acquire an 
input from a terminal together with the credit information, the 
apparatus comprising accepting means for memorizing acceptance 
information in which a condition for allowing the input to be 

20 accepted and determining whether or not the input is possible 
to be accepted on the basis of the input and the acceptance 
information . 

In the present invention, there is still provided a remote 
control system in which a gateway apparatus is connected to an 

25 outside network built outside a home and to a home network 
connected to a home appliance, the home appliance being 
remote-controlled through the outside network and the remote 
control being mediated by the gateway apparatus, wherein the 
gateway apparatus is configured to output appliance panel 

30 information of the home appliance to a control device to 
remote-control the home appliance through the outside network 
such that a figure approximating a front panel of the appliance 
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is displayed on a screen of the control device, to convert an 
operation on the panel displayed on the screen of the control 
device into a control command to the home appliance , and to send 
the produced command to the home appliance such that the home 
appliance performs an operation corresponding to the operation 
done on the panel displayed by the control device. 

As a result, the appliance can be operated through the 
network built outside the home (e.g. , Internet) from a distance 
in a feeling obtained in operating the front panel of an actual 
home appliance . 

Furthermore, in the case that a control command caused 
by a direct operation to a home appliance is issued, the control 
command is supplied to the home appliance through the gateway 
apparatus. Since the control can be integrated, a conflict 
between the direct operation and the remote control, both of 
which is toward the home appliance, can be prevented. 

Still, credit processing given by a service server 
enables the system to have higher stability, thus improving the 
reliability of the system. 

Brief D escription of the Dr awings 
In the accompanying drawings : 

Fig. 1 is a block diagram showing the configuration of 
a GW apparatus according to a first embodiment; 

Fig. 2 illustrates an operational range of each of panel 

parts ; 

Fig. 3 is a table showing appliance panel information 

table; 

Fig. 4 illustrates GW apparatus information; 
Fig. 5 is a flowchart showing the operation of the GW 
apparatus according to the first embodiment; 

Fig. 6 shows an example of an acquisition input of panel 



information; 

Fig. 7 exemplifies display on the screen of a control 
device; 

Fig. 8 shows an exemplary control command; 

Fig. 9 is a flowchart showing the operation of appliance 
control command producing means according to the first 
embodiment ; 

Fig. 10 is a block diagram showing the configuration of 
a GW apparatus according to a second embodiment; 

Fig. 11 is a flowchart showing the operation of appliance 
control command producing means according to the second 
embodiment ; 

Figs . 12A and 12B show exemplary GW apparatus information 
adopted by the second embodiment; 

Fig. 13 is a block diagram showing the configuration of 
a GW apparatus according to a third embodiment; 

Fig. 14 illustrates an appliance panel information table 
according to the third embodiment ; 

Fig. 15 is a flowchart showing the operation of appliance 
panel state updating means ; 

Fig. 16 illustrates a format notifying a change in state; 

Fig. 17 is a flowchart showing another operation of the 
appliance panel state updating means; 

Fig. 18 shows a change in the screen obtained when the 
state changes; 

Fig. 19 is a block diagram showing the configuration of 
a GW apparatus according to a fourth embodiment; 

Fig. 20 illustrates a request for acquiring a GW service 

list; 

Fig. 21 is a flowchart showing the operation of GW service 
list producing means; 

Fig. 2 2 is an example of appliance panel information; 



Fig. 23 exemplifies GW service list information; 

Fig. 24 is an exemplary display screen produced based on 
the GW service list information; 

Fig. 25 illustrates GW service list information for a 
terminal connecting to the Internet; 

Fig. 2 6 is a block diagram showing the configuration of 
a GW apparatus according to a fifth embodiment; 

Fig. 27 illustrates appliance operation status 
information; 

Fig. 28 is a flowchart showing the operation of appliance 
control command producing means of the fifth embodiment; 

Fig. 29 exemplifies the processing for producing and 
determining a command based on the appliance operation status 
information; 

Fig. 30 is a block diagram showing the configuration of 
a GW apparatus according to a sixth embodiment; 

Fig. 31 illustrates appliance operation status 
information in the sixth embodiment; 

Fig. 32 is a flowchart showing processing for producing 
and determining a command in the sixth embodiment; 

Fig. 33 illustrates information about priority control 
device IDs; 

Fig. 34 is an example of a continued operation ; 

Figs. 35A to 35D exemplify processing for producing and 
determining a command produced based on appliance operation 
status information; 

Fig. 36 is a block diagram showing the configuration of 
a GW apparatus according to a seventh embodiment; 

Fig. 37 is a flowchart showing the operation of control 
command memorizing means; 

Fig. 38 is a block diagram showing the configuration of 
a GW apparatus according to an eighth embodiment; 



Fig. 39 is a flowchart showing the procedures of 
processing for producing and determining a command ; 

Fig. 40 shows an example of acceptable time zone data 
employed as a use key; 

Fig. 41 shows an example of location identification data 
employed as a use key; 

Fig. 4 2 shows an example of terminal identification data 
employed as a use key; 

Fig. 43 shows an example of user identification data 
employed as a use key; 

Fig. 44 illustrates processing for producing and 
determining a command based on the user identification data; 

Fig. 4 5 is an example of use key information made to 
correspond to the status in appliance operation status 
information ; 

Fig. 46 is a flowchart showing the processing for 
producing and determining a command on the basis of use key 
information made to correspond to the status in appliance 
operation status information; 

Fig. 47 is an example showing the processing for producing 
and determining a command on the basis of use key information 
made to correspond to the status in appliance operation status 
information; 

Fig. 48 illustrates a plurality of pieces of use key 
information made to correspond to the status in appliance 
operation status information, in which location identification 
data differ every piece of the information; 

Fig. 49A and 49B illustrate respectively processing for 
producing and determining a command in response to pieces of 
inputted information of which originated locations differ from 
each other; 

Fig. 50 illustrates a plurality of pieces of use key 



information made to correspond to the status in appliance 
operation status information, in which user identification data 
differ every piece of the information; 

Fig. 51 exemplifies the processing for producing and 
5 determining a command at functional levels of an appliance; 

Fig. 52 exemplifies the processing for producing and 
determining a command at functional range levels of an 
appliance; 

Fig. 53 is a flowchart showing both of the processing for 
10 producing and determining a command and producing GW service 
information ; 

Figs. 54A to 54C exemplify the processing for producing 
the GW service information; 

Figs. 55A and 55B show examples of displayed screens 
15 produced based on the GW service information; 

Fig. 56 is a block diagram showing the configuration of 
a GW apparatus according to a ninth embodiment ; 
Fig. 5 7 exemplifies a contents list; 

Fig. 58 is a flowchart showing the operation of contents 
20 managing means; 

Figs. 59A and 59B show examples of the processing for 
producing and determining a command; 

Fig. 60 is a block diagram showing the configuration of 
a GW apparatus according to a tenth embodiment; 
25 Fi 9- 61 is a flowchart showing the operation of input 

distributing means; 

Fig. 62 illustrates an appliance panel information table; 
Figs. 63A to 63C are images displaying panels of a 
plurality of home appliances, the images being obtained at a 
30 remote control device; 

Fig. 64 exemplifies inputs of control commands to a 
plurality of appliances; 
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Fig. 65 illustrates an example of linked operations 
between or among a plurality of appliances; 

Fig. 6 6 shows a concept of distributing routes; 

Fig. 67 exemplifies inputs of control commands to a 
plurality of appliances on condition that information about a 
distributing condition is given; 

Fig. 68 is a flowchart showing the operation of input 
distributing means on condition that information about a 
distributing condition is given; 

Fig. 6 9 is a block diagram showing the configuration of 
a remote control system according to an eleventh embodiment ; 

Fig. 70 outlines a flowchart showing the operation of 
accepting means; 

Fig. 71 is a format of an input to which credit information 
is added; 

Figs. 72A to 72C are examples of acceptance condition 
tables ; 

Fig. 73 is a flowchart showing the operation of the 
accepting means on condition that acceptance conditions are set 
based on the type of inputs; 

Fig. 74 shows a block diagram explaining the 
configuration of the remote control system in which a service 
server performs accounting; 

Fig. 75 is an example of the acceptance condition table 
that adopts a process of accounting as a key; 

Fig. 7 6 is a block diagram exemplifying the hardware 
configuration of a home gateway apparatus; 

Fig . 77 outlines a concept showing a remote control system 
into which a home getaway apparatus according to the present 
invention is incorporated; and 

Fig. 78 outlines another concept showing a remote control 
system into which a home getaway apparatus according to the 



present invention is incorporated. 

Detailed Description of Preferred Embodiments 
(First embodiment) 
5 In a first embodiment, the fundamental configuration of 

a remote control system according to the present invention will 
now be described. 

Fig. 1 shows the entire configuration of this remote 
control system. This remote control system has a home network 

10 30 connecting home appliances 31 and 32, an outside network (for 
example, the Internet) 50 permitting the home appliances 31 and 
32 on the home network 30 to be accessed from outside the home, 
a gateway (GW) apparatus 10 connecting the home network 30 to 
the outside network 50 and acting as a mediator between 

15 communication protocols employed by them, and a control device 
6 0 used for directly inputting control commands into the GW 
apparatus 10 with no network routed. The GW apparatus 10 
functionally includes appliance panel information inputting 
means 12 for acquiring appliance panel information about 

20 control panels of the home appliances 31 and 32; GW apparatus 
information memorizing means 13 for memorizing GW apparatus 
information indicative of whether or not accepting control 
command inputs that have been sent from the outside network 50; 
appliance control command producing means 11 for receiving 

25 commands of control of the home appliances 31 and 32 from a 
control device 60 and/or outside network 50 and producing 
control commands to the home appliances 31 and 32; and command 
outputting means 14 for outputting the produced control 
commands to a desired home appliance 31 (32) , a monitor 71, and 

30 others. 

The home appliances 31 and 32 are AV devices, white goods, 
lighting fixtures, or others. The home appliances 31 and 32 
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may be equipments or devices in an office. 

The control device 60 is made up of a device capable of 
directly inputting control commands to the GW apparatus 10, 
which is for example a console (operation panel) or a remote 
5 control unit of or for the GW apparatus 10. A keyboard of the 
GW apparatus 10 can be used as the control device 60. 

Appliance panel information acquired by the appliance 
panel information inputting means 12 of the GW apparatus 10 
consists of information about panel parts of the home appliances 

10 31 and 32 and information indicative of an operational range 
of the panel parts. The operational range is, as exemplified 
in Fig. 2, a slid range when the panel parts are slide parts, 
a rotated range when the panel parts are rotation parts, or an 
action of being pushed or not when the panel parts are push 

15 buttons. The appliance panel information inputting means 12 
accepts appliance panel information notified by a home 
appliance connected to this remote control system and/or 
acquires appliance panel information by, for example, regularly 
searching each home appliance. And the inputting means is able 

20 to memorize the acquired appliance panel information. Instead 
of automatically acquiring the appliance panel information as 
above, the way that an operator manually inputs the appliance 
panel information can be adopted. 

Fig. 3 exemplifies a table of the appliance panel 

25 information memorized by the appliance panel information 
inputting means 12 . This table is set for every home appliance. 
In the table, described are the numbers of the sheets indicating 
panel parts, panel IDs identifying panel parts, display data 
of GUIs (graphical user interfaces) displayed on the sheets, 

30 contents of operations on the GUIs, commands produced by 
operations, operational ranges of the panel parts, and layout 
information about the display data on the sheets. 
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A plurality of sheets can be given to a single home 
appliance. A sheet may be arranged on another sheet. An area 
indicating the display data may be set on a sheet such that this 
area holds the layout information of the display data. 
5 The GW apparatus information memorized by the GW 

apparatus information memorizing means 13 is information 
showing whether or not a control command inputted from the 
network 50 built outside the home is possible to be accepted. 
As illustrated in Fig. 4, a flag that represents either 
10 "possible" or "impossible" is the GW apparatus information. 
The GW apparatus information is inputted by an operator or other 
means . 

Fig. 5 exemplifies a flowchart for operational procedures 

performed by the GW apparatus 10. 
15 The GW apparatus 10 selects home appliances 31 and 32 in 

the home , and then acquires panel information from the selected 

home appliances to hold it in the appliance panel information 

inputting means (step 1). 

In cases where there is a request for acquiring appliance 
20 panel information about a desired home appliance through the 

control device 60 or the outside network 50, the appliance 

control command producing means 11 in the GW apparatus 10 

accepts it (step 2), and sends back to the request sender the 

appliance panel information about a specified home appliance, 
25 which is memorized by the appliance panel information inputting 

means 12 (step 3). 

Fig. 6 shows a panel information acquiring request to be 

received by the appliance control command producing means 11. 

This request includes the type of input showing that the 
30 acquisition of pane information is requested and an objective 

appliance showing a home appliance for which appliance panel 

information is requested. 
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When receiving the panel information acquiring request, 
the GW apparatus supplies to the request sender information 
about the appliance panel information table (Fig. 3) of a 
specified home appliance. On the screen of a monitor at the 
5 request sender, as exemplified in Fig. 7, a GUI illustrating 
panel parts which are present in the control panel of the 
specified home appliance is displayed, though some GUIs are 
shown in slightly different forms from the actual panel parts. 
A user operates the GUI on the screen, so that a control command 
10 that corresponds to the operation is sent to the GW apparatus 
10. 

When receiving an input of the control command toward the 
specified home appliance from the control device 60 or the 
outside network 50 (step 4), the appliance control command 

15 producing means 11 in the GW apparatus 10 determines if or not 
the control command is possible to be accepted on the basis of 
the GW apparatus information memorized by the GW apparatus 
information memorizing means 13. 

In the case that the acceptance is impossible, the 

20 producing means rejects the control command (step 8). On the 
other hand, if the acceptance is possible, the appliance control 
command producing means 11 produces a control command (step 6) , 
and the command outputting means 14 outputs the produced control 
command (step 7). 

25 Fig. 8 illustrates an exemplary input of the control 

command accepted by the appliance control command producing 
means 11. The control command includes the type of input 
showing that control is commanded, an objective appliance to 
be controlled, the ID of a control-requesting devise, a panel 

30 ID showing operated panel parts, and an operation content. 

Fig. 9 is a flowchart showing operational procedures 
performed by the appliance control command producing means 11. 
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When receiving an input (step 10) , the appliance control 
command producing means 11 determines, based on the type of the 
input, if the input is an acquisition request for appliance 
panel information or a control command (step 11). When the 
5 input is the acquisition request, the producing means 11 
acquires necessary appliance panel information from the 
appliance panel information inputting means 12 (step 16), 
produces the appliance panel information (step 17), and 
transmits it to a request sender as a response (step 18). 

10 In contrast, when the determination at step 11 is that 

the control command is inputted, the producing means 11 
determines if or not the acceptance of the control command is 
possible on the basis of the GW apparatus information memorized 
by the GW apparatus information memorizing means 13 (step 12) . 

15 If the acceptance is impossible, the control command is rejected 
(step 15). But if the acceptance is possible, the inputted 
control command is converted to a home appliance controlling 
command by making reference to the appliance panel information 
table (step 13) , then sends it to the command outputting means 

20 14 (step 14) . 

On receiving the control command from the appliance 
control command producing means 11, the command outputting 
means 14 performs a format conversion of the command, if needed, 
and then outputs it to the specified home appliance by way of 

25 the home network 30. In addition, the command outputting means 
14 converts the control command to an adaptable form directed 
to desired output devices such as a monitor and a printer, and 
outputs its converted one to such devices . Such outputs of the 
produced control command to various output devices permit the 

30 GW apparatus to be used in a variety of modes . 

As described above, the present system uses the GW 
apparatus that serves as a mediator converting GUI information 
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in relation to home appliances. This makes it possible that 
home appliances connected to the home network are controlled 
from a distance through the Internet, in a similar operation 
feeling to operations done at the home. 
5 In addition, the present system can be used such that home 

appliances are remote-controlled from mobile terminals, such 
as a cellular phone, PDA, or notebook type of PC, through the 
Internet . 

The GW apparatus can be used as a central controller in 
10 a factory or an office, in which, through the keyboard of the 
GW apparatus, a request for panel information about appliances , 
such as air conditioners, lighting fixtures, and doors, is 
issued to monitor the present status of the panel of each 
appliance on a monitor, or a command is issued to control the 
15 operation of air conditioners, the turning lighting fixtures 
on or off, the open/close of doors, and others. 

Further, control commands issued from the GW apparatus 
can be printed by a printer to utilize them as an access log. 
Control contents for home appliances printed by a printer of 
20 the GW apparatus can be used as an operation manual for 
maintenance service, so that the same type of home appliance 
is able to be maintained according to this operation manual. 

(Second embodiment) 
25 In a second embodiment of the present invention, a remote 

system in which a remote control can be used to control home 
appliances at the home, in addition to the remote control from 
outside the house, will now be described. 

In the system according to the first embodiment, direct 
30 control of home appliances through a remote control may cause 
a conflict with the remote control from outside the house. In 
order to remove this inconvenience, the system of the second 
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embodiment adopts a configuration shown in Fig. 10. That is, 
a control command from a remote control 33 is inputted to the 
appliance control command producing means 11 of the GW apparatus 

10 via the home network 30. Based on the input indicative of 
5 the control command from the remote control 33, the appliance 

control command producing means 11 produces a command for a home 
appliance. The remaining configurations are identical to 
those in the first embodiment (Fig. 1). 

The appliance control command producing means 11 accepts 
10 from the remote control 33 a control command input similar to 
that in Fig. 8. 

Fig. 11 is a flowchart showing operational procedures 
performed by the appliance control command producing means 11. 

Practically, when the appliance control command 
15 producing means 11 receives an input (step 20), the means 11 
determines if the input is an acquisition request for appliance 
panel information or a control command (step 21). If it is 
determined that the input is the acquisition request , the means 

11 performs processing in the similar manner to steps 16 to 18 
20 in Fig. 9. 

When it is determined at step 21 that the input is the 
control command, it is further determined if the input has been 
received from inside the home or from outside the home (step 
22) . If the input has been received from inside the home, the 

25 determination whether or not it is possible to accept the 
external input from inside the home is made based on the GW 
apparatus information memorized in the GW apparatus information 
memorizing means 13 (step 23). At this determination, if it 
is impossible to accept the input, the input is rejected (step 

30 24). 

By contrast, when the input is possible to be accepted, 
the control command input is converted to a command for 
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controlling a home appliance by making reference to the 
appliance panel information table (step 27), then transmitted 
to the command outputting means 14 (step 28). 

On the other hand, when it is determined at step 22 that 
5 the input is from outside the home, it is further determined 
if the external input from outside the home is possible to be 
accepted or not on the basis of the GW apparatus information 
memorized by the GW apparatus information memorizing means 13 
(step 25) . If it is determined that acceptance of such external 
10 input is impossible, the input is rejected (step 26). But it 
is possible to accept such external input, the control command 
input is converted to a command for controlling a home appliance 
by making reference to the appliance panel information table 
(step 27) , then transmitted to the command outputting means 14 
15 (step 28) . 

Fig. 12A illustrates pieces of exemplary GW apparatus 
information memorized by the GW apparatus information 
memorizing means 13. 

In the system in which the GW apparatus information is 
20 set as in Fig. 12B, control on the remote control at the home* 
can be processed in the similar manner to the remote control 
issued from outside the home. In cases where operations are 
directed from outside and inside the home to the same home 
appliance, an operational conflict can be avoided so that 
25 priority is given to an operation issued from inside the home. 

Moreover, in the present system, the control command from 
the remote control is sent to the GW apparatus in which the 
control commands to the home appliance can be integrated to one 
command to be provided though the GW apparatus. Accordingly, 
30 a conflict of control commands between the remote control and 
the Internet is avoided. However, in cases where a user 
operates a front panel of a home appliance to control it, a 
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conflict may occur between such direct operation to the front 
panel and an operation through the Internet . 

However, such conflict can be avoided by a configuration 
in which a control command issued from a home appliance of which 
front panel is operated is sent to the appliance control command 
producing means 11 of the GW apparatus though the home network 
30, not directly to the drive of the appliance. In the 
configuration, the appliance control command producing means 
operates in a manner similar to that in Fig. 11, in which a 
control command sent from the front panel of a home appliance 
will be returned to the drive of the home appliance. 

In this way, a home appliance is configured such that the 
destination of a control command issued in response to an 
operation on the front panel thereof is switched over between 
the drive of the appliance and the GW apparatus by way of the 
home network. And the GW apparatus is configured so that it 
sends a control command back to the home appliance, when the 
home appliance sends the control command to the GW apparatus . 
This makes it possible to integrate control commands issued 
responsively to both the front panel of the home appliance and 
the remote control to that passing the GW apparatus. 
Accordingly, all possible conflicts of control commands to the 
home appliance can be prevented. 

(Third embodiment) 

In a third embodiment of the present invention, the GW 
apparatus is able to detect the newest state of each home 
appliance . 

This GW apparatus is, as shown in Fig. 13, equipped with 
appliance panel state updating means 15 for detecting the newest 
state of each home appliance to update its appliance panel 
information. Additionally, the appliance panel information 
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table stored by the appliance panel information inputting means 
12 additionally includes, as shown in Fig. 14, the item of a 
current state of each of panel parts. The remaining 
construction is identical to that in the first embodiment (Fig. 
5 1). 

As shown in Fig. 15, the appliance panel state updating 
means 15 receives a state change notification (in which a state 
of each appliance is described) sent from each home appliance, 
and updates the current state preserved by the appliance panel 

10 information table. Fig. 16 shows a format of this state change 
notification, which includes the type of notification revealing 
that this is a state change notification, the name of each home 
appliance, the panel ID of each of panel parts, the new and old 
states of each of panel parts. 

15 Moreover, as shown in Fig. 17, the appliance panel state 

updating means 15 acquires an address of each home appliance, 
sends a request for acquiring the state to each home appliance, 
and updates the current state in the appliance panel information 
table based on the state change notification received from each 

20 home appliance. 

This permits the GW apparatus 10 to detect the newest 
state of each home appliance. Accordingly, the GW apparatus 
is able to provide the newest panel state at any time, in response 
to an acquisition request for appliance panel information which 

25 is issued from either the control device 60 or a remote control 
device connected to the Internet . 

Fig. 18 illustrates changes in images displayed on the 
screen of a control device that has acquired appliance panel 
information in association with the update of the current state 

30 preserved by the appliance panel information. This example 
shows changes caused when a replay operation is selected in 
locally operating a VTR (i.e. , operations on the control panel 
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of the VTR) . The screen of the control device that has acquired 
the updated appliance panel information displays that a replay 
button is in a replay state. A modification is that panel parts 
of which states have changed may be made distinctive by blinking , 
5 highlighted display, changes in color, display by characters 
expressing the changes. 

As a result, the newest panel states of home appliances 
are provided anytime to directly connected control devices or 
remote control devices . No discrepancies occur between the 
10 panel states of such control devices and the actual states of 
home appliances , which reduces errors in control commands to 
be issued from the control devices. 

(Fourth embodiment) 

15 In a fourth embodiment of the present invention, there 

is provided a GW system capable of providing GW service list 
information to a remote control device connected to a network 
found outside the home. The GW service list information is 
provided in a format that can be utilized by the remote control 

20 device . 

A system shown in Fig. 19 includes GW service list 
producing means 16 capable of providing the GW service list 
information to a remote control device 51 connected to the 
network 50 found outside the home . The remaining is constructed 
25 in the similar manner to the first embodiment (Fig. 1). 

The remote control device 51 sends, to the appliance 
control command producing means of the GW apparatus 10, a 
request for acquiring a gateway service list shown in Fig. 20. 
The acquisition request for the gateway service list includes 
30 the ID of the remote control device, i.e., a request sender, 
and information indicating that a service list is requested. 

In the GW apparatus 10, as shown in Fig. 21, the appliance 
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control command producing means 11 receives an acquisition 
request for a gateway service list (step 30) , and then requests 
that the GW service list producing means 16 produce gateway list 
information (step 31). 
5 Responsively to this, the GW service list producing means 

16 acquires appliance panel information from the appliance 
panel information inputting means 12 (step 32) to produce the 
gateway service list information based on the appliance panel 
information (step 33). Alternatively, this gateway service 
10 list information may be produced in advance and preserved for 
actual use. 

In cases the remote control device 51 is equipped with 
a GUI as a universal tool, the GW service list producing means 
16 is able to produce information about a produce gateway 

15 service list shown in Fig. 23 by using appliance panel 
information illustrated in Fig. 22. 

The GW service list producing means 16 transmits the 
produced information about the gateway service list to the 
remote control device 51 (i.e. , the request sender) (step 34). 

20 On receiving this information about the gateway service 

list, the remote control device 51 performs a process on the 
information so as to produce a display screen shown by Fig. 24, 
for example . 

As a result, providing the information about the gateway 
25 service list to the control device connected to the network 50 
found outside the home enables the control device to be a remote 
control device that has a capability of remote -controlling home 
appliances . 

In the case that the control device 51 is connected with 
30 the GW apparatus 10 via the Internet , through processing carried 
out at step 33 in Fig. 21, the GW service list producing means 
16 uses the appliance panel information so as to produce gateway 
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service list information that is compatible to connections to 
the Internet . Thus , browser displaying data are produced 
correspondingly to types of tag sets (for example, HTML , XML, 
VML , JavaScript, style sheet, or others) supported by browsers 
5 installed in control devices, or, a program is produced 
correspondingly to the type of a virtual machine (for example, 
an applet, servlet, and others). Fig. 25 shows an example of 
the gateway service list information produced using HTML 
display data. As a modification, this gateway service list 

10 information may previously be produced and preserved. 

Thus it is possible that the gateway service list 
information can be provided to control devices connected to the 
GW apparatus via the Internet . The control devices can 
therefore be used as remote control devices for each home 

15 appliances. 

(Fifth embodiment) 

A fifth embodiment of the present invention provides a 
system that has a function that removes invalid control commands 

20 issued from remote control devices to home appliances. 

The GW apparatus shown in Fig. 26 has appliance operation 
status inputting means 17 for memorizing an operated status of 
each home appliance. The remaining is similar in construction 
to the first embodiment (Fig. 1). 

25 Fig. 2 7 illustrates information about appliance 

operation statuses memorized by the appliance operation status 
inputting means 17. In this appliance operation status 
information, how the statuses change responsively to operations 
onto panel parts is described and the current status is also 

30 described . For instance , pushing a button B2 allows the current 
status S2 (in replay) to transit to the initial state SI. 

Fig. 28 shows procedures carried out by the GW apparatus 
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when a remote control device sends a control command to home 
appliances . 

When receiving input information about a control command 
from the remote control device {step 40) , the appliance control 
5 command producing means 11 acquires not only appliance panel 
information from the appliance panel information inputting 
means 12 but also GW apparatus information from the GW apparatus 
information memorizing means 13, and then produces a control 
command based on the acquired and received information (step 
10 41). 

Then the appliance control command producing means 11 
acquires appliance operation status information from the 
appliance operation status inputting means 17 (step 42), and 
determines if the control command is valid or not (step 43) 

15 through comparison between the input information and the 
appliance operated state information. In other words, it is 
determined whether or not the next status commanded by the 
control command is allowed to transit from the current status. 

If the command is valid, the appliance control command 

20 producing means 11 transmits the produced command to a certain 
home appliance (step 44), then updates the current status in 
the appliance operated state information (step 45). 

In contrast, unless it is determined at step 43 that the 
command is valid, the produced control command will be 

25 prohibited from being transmitted (step 44). 

Fig. 29 shows changes in the appliance operated state 
information, in which a control command to push the button B2 
has newly been inputted in the appliance operation status 
represented in Fig. 27. This control command is valid, so that 

30 the "current status" included in the appliance operation status 
information has been updated to a new status SI realized when 
the button B2 is pushed. 
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According to the GW apparatus, the control commands 
produced in replay to input from control devices are subjected 
to determining if the command is valid or not, based on types 
and statuses of home appliances. This determination prevents 
5 invalid commands from being transmitted to home appliances . It 
is therefore unnecessary for each home appliance to have means 
for performing processing to determine the validity of control 
commands . 

10 (Sixth embodiment) 

A sixth embodiment of the present invention provides a 
GW system that has the capability of avoiding a certain control 
device from interrupting another control device in operation 
for remote control. 

15 The GW apparatus includes, as shown in Fig. 30, appliance 

operation status inputting means 17 that stores therein 
appliance operation status information. This information 
includes ID information about priority devices that should be 
controlled in preference to others. The remaining 

20 construction is the same as that in the fifth embodiment (Fig. 
26). 

The appliance operation status information differs from 
that used in the fifth embodiment (Fig. 27) in that, as shown 
in Fig. 31, the information has a priority device ID described 

25 in a given column and a continued operation status indicated 
by an asterisk " * . " The continued operation status shows a 
waiting status for the next operation to be continued, as 
represented by S4 * (reservation of recording and waiting for 
channel input) and S5 * (reservation of recording and waiting 

30 for time input). In the case that the current status of a 
certain home appliance is assigned to a continued operation 
status, a control device that performed such an operation is 
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memorized as a priority device. After this memorization, 
commands will be produced only for continuous operation inputs 
issued by this control device. 

A flowchart in Fig. 32 shows the operation of the GW 
5 apparatus 10. 

Practically, the appliance control command producing 
means 11 acquires inputted information about a control command 
from a certain control device and a control device ID indicative 
of the control device (step 50). 

10 Then, when the current status shown by the appliance 

operated state information does not correspond to a continued 
operation status ( step 51 ) , a command is produced, together with 
determination of validity of the command, on the basis of the 
inputted information, appliance panel information, GW 

15 apparatus information, and appliance operated state 
information (step 52: the similar processing to steps 41 to 46 
in Fig. 28 ) . 

In the case that the operation reveals a continued 
operation status after the produced command was transmitted 

20 (step 53), the control device ID is then memorized as the 
priority control device ID (step 54). As shown in Fig. 33, 
information about the priority control device ID is described 
by this memorization. 

When the current status indicated by the appliance 

25 operated state information corresponds to a continued operation 
status and the priority control device ID agrees with the 
acquired control device ID (steps 51 and 55), a command is 
produced, together with determination of validity of the 
command, on the basis of the inputted information, appliance 

30 panel information, GW apparatus information, and appliance 
operated state information (step 57: the similar processing to 
steps 41 to 46 in Fig. 28). 
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In the case that the operation does not a continued 
operation status after the produced command was transmitted 
(step 58) , the priority control device ID is deleted (step 59) . 
When the current status shown by the appliance operation 
5 status information shows a certain continued operation status 
and the priority control device ID disagrees with the acquired 
control device ID, a command will be prohibited from being 
produced (step 56). 

As stated above, as long as the current status included 
10 in the appliance operated state information shows the continued 
operation state, the appliance control command producing means 
11 produces commands in response to only continuous operations 
done toward the same control device. 

Fig. 34 represents an example of continuous operations 
15 carried out at a certain control device, which causes the status 
of a specified home appliance to make transitions of SI, S4 
* , S5 * , to S6. Because S4 * and S5 * are continued operation 
statuses, control commands produced in response to operations 
on the other control devices will not be transmitted to this 
20 home appliance until the status thereof changes to S6, which 
is not the continued operations status. 

Figs. 35A to 35D exemplify various relationships between 
updated conditions of the appliance operation status 
information and a command to be transmitted, which are 
25 responsive to input of control commands . 

The above operation provided by the GW apparatus permits 
a certain control device to perform a series of operations with 
no interruptions from other control devices or terminals. 

30 ( Seventh embodiment ) 

A seventh embodiment of the present invention provides 
a GW apparatus that is able to send, to a home appliance, with 
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no intervals , commands made on a series of remote control 
operations done at a control device. 

In order to realize this, a GW apparatus shown in Fig. 
36 has control command memorizing means 19. This means 19 has 
5 memorizes commands produced by the appliance control command 
producing means 11, during which time the means 19 transmits, 
in turn and without intervals, the commands memorized so far, 
once waiting for continuous operations is removed. The 
remaining configuration is the same as that in Fig. 6 (Fig. 30) . 

10 Fig. 37 shows the procedures of processing performed by 

the control command memorizing means 19. 

The control command memorizing means 19 receives a 
command produced by the appliance control command producing 
means 11 to memorize it at the received order (61). Then the 

15 control command memorizing means 19 determines if or not the 
current status included in the appliance operation status 
information is a continued operation status (step 62). 

If the determination results in a continued operation 
status, the processing is shifted to step 61. But the 

20 determination does not reveal a continued operation status, the 
control command memorizing means 19 transmits the memorized 
commands to a specified home appliance at the received order, 
then deletes the memorized contents (step 63). 

The above processing, which is performed by the control 

25 command memorizing means 19, is independent of the processing 
performed by the appliance control command producing means 11. 

In this way, the control command memorizing means 
memorizes commands before transmitting them in sequence, so 
that a series of those commands can be transmitted with no 

30 interruptions from other devices or terminals. Additionally, 
a series of inputting operations to a home appliance can be done 
continuously, thus operations of the home appliance being 
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conducted with stability and being secured. 
(Eighth embodiment) 

An eight embodiment of the present invention provides a 
5 GW apparatus that includes the functions of determining whether 
or not a control device satisfies a given use condition and 
permitting remote control for home appliances thorough the 
control device only when the use condition is satisfied. 

As shown in Fig. 38, the GW apparatus has use key 

10 information inputting means 20 for acquiring a usable condition 
(key to utilize) to make a control device usable for controlling 
home appliances from a distance and memorizing a use key (key 
to use). Additionally, the appliance control command 
producing means 11 is constructed such that, when a control 

15 command to a certain home appliance is inputted from a control 
device connected to the network outside the home, the means 11 
determines whether or not a control command to the home 
appliance should be produced on the basis of the appliance panel 
information memorized by a control device connected to the 

20 network outside the home, the GW apparatus information 
memorized by the GW apparatus information memorizing means 13, 
the appliance operation status information memorized by the 
appliance operation status inputting means 17, and the use key 
information memorized by the use key information inputting 

25 means 20. The remaining is constructed in the same way as that 
in the fifth embodiment (Fig. 26). 

The appliance control command producing means 11 is 
configured so as to perform determination whether or not it is 
possible to produce a command on use key information in the 

30 procedures shown in Fig. 39. In other words, when acquiring 
inputted information (step 65) , the appliance control command 
producing means 11 determines whether or not it is possible to 
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produce a command based on the inputted information and the use 
key information memorized by the use key information inputting 
means 20 (step 66) . 

The determined results at step 6 6 is used at step 67 such 
that, like in Fig. 28, a command is produced and transmitted 
as long as the use key is satisfied, while a command will not 
be transmitted if the use key is not satisfied. 

The use key information inputting means 20 preserves a 
conditional expression as the use key information, so that the 
appliance control command producing means 11 is able to use the 
conditional expression to determine if it is possible to produce 
a command or not. The conditional expression includes 
acceptable time zone data that limit acceptable time for 
operations (Fig. 40), location identification data that limit 
the acceptable locations of control devices to locations in the 
domestic area of Japan, the area inside the home, the area 
covered by a radius of 1 kilometers from a home, or others (Fig. 
41), terminal identification data that limit control devices 
with IDs (Fig. 42), user identification data that limit users 
with IDs, fingerprints, or others (Fig. 43), and expressions 
made by combining a plurality of data selected from the above 
listed expressional data with use of "and" or "or." 

Fig. 44 exemplifies determination whether it is possible 
to produce a command using the use key information. The 
appliance control command producing means 11 operates such that , 
when receiving inputted information about a user ID "E," the 
means 11 compares the inputted user ID with the user 
identification data stored in the use key information inputting 
means 20 , so that it is determined if the user ID "E" is contained 
or not in user IDs expressed by the user identification data. 
In this example, since the ID "E " is not contained in the user 
IDs, the appliance control command producing means 11 will not 
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produce any command. 

Fig. 45 shows an example to make the use key information 
correspond to statuses expressed in the appliance operation 
status information of a VTR. In this case, for recording by 
5 operating a button B3 and making a reservation for recording 
by operating a button B4 at the initial state SI, it is required 
that user identification data regulated by a key 1 be met. 

Therefore, the appliance control command producing means 
11 operates as shown in Fig. 46. 
10 When receiving information inputted from a control device 

(step 70), the means 11 acquires appliance panel information 
and gateway apparatus information, then produce a command based 
on both the acquired information and the inputted information 
(step 71) . 

15 Then, the means 11 acquires appliance operation status 

information (step 72), and then the determination whether or 
not the produced command is valid by making reference to both 
the appliance operation status information and the use key 
information (step 73). 

20 If the produced command is valid, it is transmitted to 

a given home appliance (step 74) , before the appliance operation 
status information is updated (step 75). However, when the 
produced command is invalid, no command will be transmitted 
(step 76)'. 

25 On the assumption that the use key information is 

specif ied as in Fig. 45, Fig. 47 illustrates the input of control 
command information indicative of the user ID "005" and the 
button B3 "push" (recording) and the determination whether or 
not it is possible to produce a command. Because the appliance 

30 operation status information allows the "button B3" to be pushed 
under the current status SI , the inputted information meets a 
requirement for the appliance operation status information. 
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However, the condition of a key 1 added to this operation is 
not met. The control command on this inputted information does 
not become valid when being referred to both the appliance 
operation status information and the use key information . This 
determined result is considered by the appliance control 
command producing means 11, so no command will be produced. 
Therefore, the status is not changed, with the result that the 
appliance operation status information is not updated. 

Fig. 48 shows an exemplary limitation, in which two pieces 
of use key information about keys 2 and 3 that specify the 
conditions for locations are made to correspond to the status 
of the appliance operation status information. 

Furthermore, on condition that the above use key 
information on the keys 2 and 3 is set. Figs. 49A and 49B show 
the determination whether or not it is possible to produce a 
command, respectively. In the case of Fig. 49A, such 
determination is made in the situation in which inputted is 
control command information indicative of "a location is within 
an area covered by 1 km from the home and the button Bl is pushed. - 
This information is inputted to make an air conditioner turn 
on from a remote location within an area covered by 1 km from 
the home. On the other hand, in Fig. 49B, the determination 
is made in the situation in which inputted is control command 
information indicative of "a location is within an area covered 
by 1 km from the home and the button B3 is pushed." This 
information is inputted to set a temperature of an air 
conditioner from a remote location within an area covered by 
1 km from the home. In the case of Fig. 49A, the requirement 
from the appliance operated state information is satisfied by 
the inputted information, and the location condition required 
by the key 2 added to this requirement is also satisfied. Hence, 
based on both the appliance operation status information and 
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the use key Information, it is determined that the control 
command on the inputted information is valid, so that the 
appliance control command producing means 11 produces a command 
on the inputted information, then sends out the produced command. 
Accordingly the status of the air conditioner is changed to 
"on," and the appliance operation status information is 
updated. 

In contrast, although the inputted information in Fig. 
49B satisfies the requirement of the appliance operation status 
information, but does not satisfy the location condition 
required by the key 3 added to the requirement. The command 
of setting a temperature derived from the inputted information 
is determined to be invalid with reference to both the appliance 
operation status information and the use key information. 
Hence the appliance control command producing means 11 will not 
produce a command based on the inputted information. 
Accordingly, the status is not changed, and the appliance 
operation status information is not updated. 

Fig. 50 exemplifies three pieces of use key information 
consisting of keys 1, 9 and 10 that specify user IDs, the three 
pieces of use key information being made to correspond to 
statuses of the appliance operation status information for a 
VTR. In this case, a user who is able to access the VTR is 
limited by the key 9, in which a user who is able to perform 
individual operations is further limited by the key 1 or 10. 

Assume that the utilizing key information shown in Fig. 
50 is set. If information about a control command of "user ID 
= G and B3 push" for recording is inputted from a user G, a 
determination whether or not it is possible to produce a command 
is carried out as shown in Fig. 51. This inputted information 
does not meet the condition regulated by the key 1, so that no 
command will be produced. In this way, the right of use can 



be limited by functions of a home appliance. 

Fig. 52 shows the determination whether or not it is 
possible to produce a command in cases a control command of "user 
ID = D and timer 150 push" specifying picture recording for 150 
minutes using the timer is inputted from a user D. Because this 
inputted information does not meet the condition of the key 10, 
no command will be produced. In this way, it is possible to 
set an amount of recording time to limit the right of use in 
association with an operation for recording with a timer, that 
is, it is possible to confine the right of use by the range of 
a function of a home appliance . 

In the above examples, a plurality of keys have been 
combined with "and," but they can be combined with "or." 

Further, in cases where an operation from a remote control 
device results in the update of the current status of a home 
appliance and use key information corresponding to the status 
changes the range of an appliance panel which is operational 
by the remote control device, the appliance control command 
producing means 11 produces gateway service list information 
showing an operational range of the appliance panel, and sends 
it to the remote control device. 

The appliance control command producing means 11 performs 
such processing based on the procedures shown in Fig. 53. In 
this processing, steps 70 to 76 are the same in processing as 
those in Fig. 46. Therefore, after the update of the appliance 
operation status information, the appliance control command 
producing means 11 uses both the updated status and the use key 
in order to determine whether or not each operation toward panel 
is valid. And the means 11 produces gateway service list 
information in such a manner that the determined result can be 
recognized on a display screen, then transmits it to a certain 
control device (step 77). 



If the appliance operation status information is set as 
shown in Fig. 54A and the status of an air conditioner is updated 
to S2 in response to remote control from a control device, 
gateway service list information to be transmitted to a certain 
5 control device is exemplified in Figs. 54A to 54C. When the 
control device in charge of the remote control is a terminal 
001 that satisfies only the condition of the key 2, information 
shown in Fig. 54B is transmitted, as gateway service list 
information, which indicates that operations other than the 
10 operation B2 allowing operations from the current status B2 are 
valid. In this situation , panel information illustrated in Fig . 
55A is displayed on the display screen of the terminal 001. 

On the other hand, when the control device in charge of 
the remote control is a terminal 002 that satisfies the 

15 conditions of the keys 2 and 3, information shown in Fig. 54C 
is transmitted, as gateway service list information, which 
indicates that operations other than the operations B2 and B3 
allowing operations from the current status B2 are invalid. In 
this situation, panel information illustrated in Fig. 55B is 

20 displayed on the display screen of the terminal 002. 

Accordingly, the appliance control command producing 
means 11 is able to transmit, to a control device, gateway 
service list information explicitly showing an operational 
range in real time. This provides an interface in accordance 

25 with changes in the right of use, the changes depending on used 
conditions . 

As described above, the present system makes it possible 
to examine the right of use at a variety of levels . The reason 
is that various conditions for remote control of home appliances 
30 can be specified, together with various setting manners. These 
manners include to set conditions to access to home appliances, 
to set conditions to functions of home appliances, or to set 
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conditions to the range (used range) of a specified function. 

The location information that rules conditions of use 
includes positional information about a control terminal, a 
geographical area (regions such as Kanto, Chubu, or Hokkaido; 
or small areas such as °xx ward"), a floor of a building, the 
domain of a network (addresses etc.), a room of the home, or 
a location of a remote control. Further, the information about 
terminal identification data includes the number of a cellular 
phone or the ID of a terminal. The user identification 
information can be set by making use of authentication 
information at a terminal with an authentication function or 
information that proves authentication on authentication 
service . 

Furthermore, it is not always necessary that the 
identification data contained in inputted information be 
inputted form a control device. Alternatively, information 
such as the telephone number of a sender which is added and used 
by processing through a network, positional information from 
a position-measuring equipment attached to a control terminal, 
or time information obtained from a timer of a control device 
or the GW apparatus can be used as the identification data. In 
short , any information can be used in the GW apparatus , as long 
as the information serves as data to identify inputted 
information in determining whether or not it is possible to 
produce a command. 

(Ninth embodiment) 

A GW apparatus according to the present invention is 
detected to examination of the right of use of contents . 

The GW apparatus has, as shown in Fig. 56, contents 
managing means 21 for memorizing a list of contents preserved 
by home appliances 31 and 32 connected to the home network 30. 
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The remaining is the same as that in the eighth embodiment (Fig. 
38). 

The contents managing means 21 memorizes, as illustrated 
in Fig. 57, a contents list in which contents IDs preserved by 
home appliances, the numbers of the use keys made correspond 
to each of the contents IDs, and access states to the contents 
are described. When a control device controls each of the home 
appliances 31 and 32 to have access to its contents , the contents 
managing means 21 senses the access through each home appliance 
31 or 32, and the determines, based on the procedures shown in 
Fig. 58, whether the access to its contents is permitted or not. 

Practically, the contents managing means 21 detects a 
request for accessing the contents preserved by a certain home 
appliance (step 80). Then, based on the inputted information 
and a use key corresponding to contents for which access was 
requested, the contents managing means 21 determines if the 
access should be permitted or not (step 81). 

If the access is permitted, the contents are released. 
In contrast, the access is not permitted, information showing 
that the access is not permitted is transmitted via the 
appliance control command producing means 11 to a control device 
that first issued the request. The determination for access 
to contents is carried out an independent processing routine. 

Fig. 59A exemplifies processing when a VTR 1 issues an 
access request for contents of "contents ID : a. " In a contents 
list shown therein, a use key is set to contents "a" which 
includes the specification of a user and the specification of 
a location limiting a usable region to the domestic area. Since 
inputted information from a control device does not meet the 
specification of the location given to the use key, the access 
to the contents will not be allowed. So contents indicating 
the non-allowance is transmitted to the control device so as 
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to be displayed on its screen. 

Like the above. Fig. 5 9B shows an example in which access 
to contents "b" will not be allowed, because it does not satisfy 
the condition of the use key specifying the user. 

The system provided by this embodiment is able to limit 
a region or time zone in which access to contents is allowed, 
and to limit users who are able to access contents. 

(Tenth embodiment) 

In a tenth embodiment of the present invention, there is 
provided a plurality of GW apparatuses that operate in a linked 
manner . 

The system shown in Fig. 60 is provided with a plurality 
of GW apparatuses 10 and 23 each connected to the network 50 
found outside the home. Each of the GW apparatuses 10 and 23 
has input distributing means 22 (24) for receiving inputs of 
control commands from a remote control device 51 and extracting 
from the inputs only a control command input toward home 
appliances that should be controlled by itself. 

Each of the input distributing means 22 and 24 hands the 
extracted control command input to the appliance control 
command producing means 11. Responsively to this, the 
appliance control command producing means 11 produces a control 
command to send it to a certain home appliance. 

Additionally, each of the input distributing means 22 and 
24 transfers other control command inputs to other GW 
apparatuses specified. 

Fig. 61 shows a flowchart showing an operation for the 
input distribution carried out by each GW apparatus . 

When receiving an input (step 85) , the input distributing 
means of each GW apparatus distinguishes a control command input 
to the GW itself from that to the other GW apparatuses (step 



86). Control command inputs to other GW apparatuses are 
transferred to specified GW apparatuses (step 88), while the 
control command input to the GW apparatus itself is transferred 
to the appliance control command producing means owned by this 
5 GW apparatus (step 87). 

Accordingly, it is possible for this system to 
simultaneously control home appliances that are controlled by 
a plurality of GW apparatuses. A control command can be sent 
from the remote control device 51 to a plurality of home 
10 appliances so as to operate in a linked manner, for example, 
for dubbing. 

The appliance panel information inputting means 12 of the 
GW apparatus preserves, as shown in Fig. 62, an appliance panel 
information table of each home appliance, to which information 
15 about linked functions is added. The information about linked 
functions includes information describing home appliances to 
which permission of linkages are given, GW apparatuses to which 
those appliances belong, and contents of linked operations. 

When controlling a plurality of home appliances from a 
20 distance, the remote control device 51 acquires panel 
information about the plurality of home appliances from GW 
apparatuses, then displays the acquired information on its 
display screen. 

The processing for display panel information about a 
25 plurality of home appliances on the display screen of the remote 
control device 51 is as follows. 

First the appliance control command producing means of 
the GW apparatus 10 receives from the remote control device a 
request for acquiring panel information, and hands it to the 
30 GW service list producing means (process (1)). 

The GW service list producing means of the GW apparatus 
10 produces GW service list information based on the appliance 
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panel information in the appliance panel information inputting 
means and the linked function information (process (2)). 

In the remote control device 51, in addition to display 
of the panel information of the specified home appliance (refer 
5 to Fig. 63A) , the functions that permits the specified appliance 
to be linked in operation with other appliances are displayed 
in a list (refer to Fig. 63B) (process (3)). 

When one linked operation is selected, through the remote 
control device 51, from the list displayed in process (3) 
10 (process (4)), a command to acquire remote panel information 
is transmitted to the GW apparatus 10, and such command is then 
transmitted from the GW apparatus 10 to the specified GW 
apparatus 23 (process (5)). 

In response to reception of the panel information 
15 acquiring request, the GW apparatus 23 produces GW service list 
information in the same manner as above, and then returns it 
to the GW apparatus 10 (process (6)). 

The GW service list producing means of the GW apparatus 
10 combines the GW service list information received from the 
20 other GW apparatus 23 and its own GW service list information, 
and then sends the combined information to the remote control 
device 51 (process (7)). 

Therefore, at the remote control device 51, the panel 
information of two appliances is displayed together with 
25 control information about linked functions (like buttons for 
dubbing) (process (8), refer to Fig. 63C). 

Fig. 64 shows a format of control commands outputted from 
the remote control device 51 to the GW apparatuses in answer 
to pressing a bubbling button for on the screen thereof. 
30 Each GW apparatus takes in only a control command directed 

to the GW itself from the received control commands, so that 
the dubbing is performed. 
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In the present system, it is possible to simultaneously 
control the home appliances under control of a plurality of GW 
apparatuses , so that a plurality of home appliances can be 
linked to perform various types of processing. 
5 As further liked processing that involves a plurality of 

home appliances, there can be provided an example shown in Fig. 
65. This example includes other various types of linked 
functions involving two appliances, such that one appliance 
replays video, during which time the other selects a channel 

10 to the video (that is, remote replay); one appliance selects 
a channel, during which time the other records vide of the 
channel {that is. remote recording); one appliance selects a 
channel, during which time the other displays the selected 
channel screen as well (sharing of the same screen); and one 

15 appliance is a camera photographing video, while the other is 
an appliance to display the photographed video or record it. 

Additionally, in order to efficiently transfer to a 
specified GW apparatus control commands inputted from the 
remote control device, information about distributing 

20 conditions to specify distribution routes may be added to a 
control command input . 

This distribution routes are decided according to 
communication capabilities of the network to which the remote 
control device is connected and the network to which the GW 

25 apparatuses are connected. As shown in Fig. 66, the 
distribution routes are displayed on the screen of the remote 
control device. The distribution routes are transmitted to the 
GW apparatuses in such a format as shown in Fig. 67, when an 
operation button is pressed. 

30 As shown in Fig. 68, in each GW apparatus, when inputs 

are received by the input distributing means (step 90), the 
information about distributing conditions are referred to 
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distinguish a control command input requiring that the GW 
apparatus itself be an originator for distribution, from other 
control command inputs requiring that other GW apparatuses be 
an originator (step 91). 

The command inputs requiring that other GW apparatus be 
an originator are then transferred to specified ones of the 
other GW apparatuses (step 94) . In contrast, the command input 
requiring that the GW apparatus itself be an originator for 
distribution is further subjected to separation of a control 
command input directed to the GW apparatus itself from control 
command inputs to other GW apparatuses (step 92). 

The command inputs to the other GW apparatuses are then 
transferred to specified ones of the other GW apparatuses (step 
95) , whilst the control command input to the GW apparatus itself 
is sent to its appliance control command producing means (step 
93) . 

In this way, based on the information about distributing 
conditions for control command inputs , the GW apparatus finds 
that the remaining control command inputs should be re- 
distributed to which GW apparatus. It is therefore possible 
to decide distributing routes according to the capability of 
the network, so that an amount of overhead in communication can 
be reduced. Delays of control commands due to linked 
operations can therefore be reduced. 

(Eleventh embodiment) 

An eleventh embodiment of the present invention provides 
a system that permits the GW apparatus to cooperatively operate 
with an external service server. 

In this system, as shown in Fig. 69, a service server 52 
that produces credit information is connected to the network 
50 found outside the home and the GW apparatus 10 is provided 
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with accepting means 25 for accepting only reliable inputs. 

When sending a command for panel information acquisition 
and/or a control command, the remote control device 51 first 
sends toward the service server a request for issuing credit 
5 key information. On receiving the request, the service server 
52 returns the credit key information to the remote control 
device 51. This device 51 sends to a given GW apparatus 10 both 
of the command for panel information acquisition and a control 
command, together with the credit key information. 

10 Fig. 70 shows a flowchart of the operation carried out 

by the accepting means 25 of the GW apparatus. 

The accepting means 25 receives input (step 100). This 
input includes, as shown in Fig. 71, command information to 
which encoded credit key information is added. 

15 The accepting means 25 uses a decoding algorithm 

previously acquired from the service server 52, so that the 
credit key information is decoded (step 101). Then, an 
acceptance condition table in which described are necessity or 
unnecessity of pieces of credit key information is referred, 

20 before the determination whether the accepted credit key 
information is required or not required is made (step 102). 

Figs. 72A to 72C show exemplary acceptance condition 
tables. Fig. 72A shows one table, in which an unchanged 
acceptance condition is set for a single service server. Fig. 

25 72B shows anther table, in which different acceptance 
conditions, which differ service by service, are set for a 
plurality of service servers . 

In Fig. 70, in cases it is determined at step 102 that 
the credit key information is "not required" (step 102), the 

30 input is transferred, as it is, to the appliance control command 
producing means (step 104). In contrast, if it is determined 
at step 102 that the credit key information is "required," the 
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decoded credit key information is confirmed in terms of its 
contents (step 103). If the contents are not correct, the 
input is rejected (step 105) , while if the contents are correct, 
the input is transferred to its appliance control command 
5 producing means (step 104). 

Alternatively, as shown in Fig. 72C, it can be done that 
conditions in the acceptance condition table are changed 
depending on the type of input. In that case, the acceptance 
means 25 operates based on a flowchart illustrated by Fig. 73. 

10 Practically, the type of an input that has been received is 
determined (step 106), the type of the input is used as a key 
to make reference to the acceptance condition table, and it is 
determined whether or not the credit key information is required 
or not required (step 107). 

15 A further alternative system can be configured as shown 

in Fig. 74, in which the service server 52 is responsible for 
accounting and the GW apparatus accepts only inputs to which 
accounting have been finished. In this configuration, before 
sending control commands to the GW apparatus 10, the remote 

20 control device 51 performs necessary processing such as payment 
to the service server 52, then requests that the certification 
that it has already been charged be issued. The service server 
52 then responds by returning information about the settlement 
certification to the remote control device 51. Then the remote 

25 control device 51 sends a control command, together with the 
information about the settlement certification, to the 
specified gateway apparatus 10. 

An acceptance condition table used in such a case is shown 
in Fig. 75. According to this table, as for the type of input 

30 that requires accounting, it is necessary to confirm the credit 
key information. As a result, the accepting means 25 uses the 
decoded key information to confirm that given accounting has 
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been finished, and then transfers the input to the appliance 

control command producing means . 

In the present system, it is therefore possible to conduct 

various kinds of credit service in association with external 
5 service servers, thus only reliable control inputs being 

forwarded to the GW apparatus. Alternatively, it is also 

possible to introduce an accounting scheme in order to provide 

service that links control of home appliances to accounting. 

For example, one business mode can be provided in which a 
10 business body that manages a service server lends users the GW 

apparatuses and users ' access to home appliances via the GW 

apparatuses causes accounting at the service server. 

As described, the foregoing various remote control 

systems make it possible that home appliances are controlled 
15 via the Internet . Moreover, like an operating feeling obtained 

in operating home appliances at the home , they can be controlled 

from outside the home. 

Further, since the direct control and remote control to 

home appliances are integrated to one route by the gateway 
20 apparatus, so that both types of control can be prevented from 

conflicting with each other. 

Still further, the credit processing at the service 

server provides the remote control system with stability, thus 

improving reliability of the system. 
25 In addition, the home gateway apparatuses 10 and/or 23 

described in each of the above embodiments are constructed into 

hardware with a computer system in which CPU (central processing 

unit) is incorporated. One such example is shown in Fig. 76. 

In detail, the home gateway apparatus 10(23) has an interface 
30 200 capable of communicating with external systems. The 

interface 200 is coupled with a bus 201, and the bus 201 is 

connected to a CPU 202, ROM 203, RAM 204, clock 205, and others. 
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The CPU 202 is able to perform the foregoing remote control and 
the processing for various types of management directed to the 
control, based on programs previously stored by the ROM 203. 
In consequence, the ROM 203 constitutes a recording medium in 
which a program according to the present invention is stored. 
Such hardware configuration is able to provide the various 
functions (means) described in each of the embodiments. 

Although the foregoing embodiments are constructed such 
that the Internet is adopted as the network found outside the 
home and the home gateway apparatus itself, which is located 
at the home, has an IP address to be connected to the Internet, 
modifications are also possible in this respect. The network 
found outside the home may be a network referred to as a 
commercial provider network or commercial provider access 
network. The Internet connection service carried out by 
providers can also be utilized. 

Exemplified in Figs. 77 and 78 are constructions for 
remote control service using the gateway apparatus according 
to the present invention. The construction shown in Fig. 77 
corresponds to the first to tenth embodiments, in which the home 
gateway apparatus of the present invention is located only 
inside a house (home). The home gateway apparatus located at 
each home is given the functions including the production of 
necessary display screens , user management , access management , 
protocol conversion, and contents management. The home 
getaway apparatus 210 is accessed via the Internet 211 serving 
as the network found outside the home. 

On the other hand, in the construction shown in Fig. 78, 
part of the functions of the home getaway apparatus according 
to the present invention is located in a portal site 212 for 
information home appliances, which is built outside the home. 
This information home appliance portal site 212 is realized by 



an information home appliance server 213 connected to the 
Internet 212 serving as a network found outside the home. The 
foregoing functions, such as the production of necessary 
display screens , user management , access management , protocol 
5 conversion, and contents management , are functionally prepared 
in the information home appliance portal site 212. Thought the 
home gateway apparatus 210 at the home is connected to the 
Internet 211, only the function of the protocol conversion is 
given to this home gateway apparatus 210, by way of example. 
10 This configuration is able to reduce the processing load given 
to the home gateway apparatus 210 itself. Thus a home-use 
telephone, hub unit, personal computer, game apparatus, or 
others, which has a communicating function, can be used as the 
home gateway apparatus 210, so that it can be provided easily. 
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